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Bounded  Error  Adaptive  Control 


Abstract 


Part  I 

Benjamin  B.  Peterson  and  Kumpati  S.  Narendra 
Yale  University 


Adaptive  identification  and  control  problems  when  the  output  error  between 
plant  and  model  cannot  be  made  to  tend  to  zero  are  discussed.  These  include 
cases  when  the  plant  output  is  corrupted  with  noise  and  when  plant  parameters 
vary  with  time.  The  principal  aim  is  to  determine  adaptive  laws  so  that  all  the 
signals  in  the  overall  system  are  bounded. 

It  is  first  shown  that  an  error  model  can  be  derived  which  is  described 
by  a  non-homogeneous  differential  equation.  If  the  external  disturbance,  plant 
parameter  variations,  and  input  are  bounded  and  the  input  is  sufficiently  rich 
the  parameter  error  vector  is  bounded  and  explicit  bounds  are  presented.  If 
the  input  is  not  sufficiently  rich,  conditions  for  boundedness  and  unboundedness 
of  the  parameter  error  vector  are  derived  and  examples  of  unstable  systems  are 
given. 

Finally,  for  the  control  problem  where  the  input  cannot  be  assumed  to  be 
bounded,  a  nonlinear  adaptation  algorithm  is  suggested.  The  need  for  such  an 
algorithm  is  shown  by  considering  simple  systems  in  which  the  parameter  error, 
almost  always,  becomes  unbounded  if  the  disturbance  does  not  tend  to  zero.  By 
adjusting  the  parameters  of  the  algorithm  it  is  shown  that  the  boundedness  of 
all  the  signals  in  the  system  can  be  assured.  The  method  can  be  extended  to 
more  general  adaptive  control  problems  which  will  be  considered  in  greater  detail 


in  a  subsequent  report. 


I .  Introduction: 


The  global  stability  of  single-input  single-output  systems  which  had 
remained  an  open  problem  for  two  decades  was  recently  resolved  for  both  con¬ 
tinuous  [1]  [2]  and  discrete  systems  [3]— [6] .  It  is  also  now  realized  that  the 
different  adaptive  schemes  which  were  developed  independently  for  Model  Refer¬ 
ence  Adaptive  Control  (MRAC)  and  Self  Tuning  Regulators  (STR)  are  all  equivalent. 
The  assumptions  that  have  to  be  made  regarding  the  unknown  plant  are  also  trie 
same  for  the  various  schemes  and  are  found  to  be  too  restrictive.  In  particular, 
the  assumption  regarding  an  exact  knowledge  of  the  relative  degree  of  the  plant 
transfer  function  is  rarely  satisfied  in  practical  situations.  Hence  it  was 
suggested  in  [7]  that  the  adaptive  control  problem  should  be  reformulated  so  that 
less  is  demanded  of  the  controller  allowing  fewer  assumptions  to  be  made  regarding 
the  plant.  This  led  to  the  study  of  bounded  error  adaptive  control  in  which  a 
bounded  error  between  plant  and  reference  model  is  all  that  is  required  instead 
of  perfect  output  matching. 

All  the  globally  stable  schemes  described  in  [1-6]  assume  that  the  plant  out¬ 
put  can  be  measured  exactly.  As  discussed  in  [8],  such  systems  lead  to  error 
models  which  can  be  described  by  homogeneous  differential  and  difference  equations. 
In  this  paper,  we  study  in  detail  error  models  described  by  non-homogeneous  dif¬ 
ferential  equations.  The  importance  of  these  error  models  lies  in  the  fact  that 
they  allow  adaptive  systems  with  measurement  noise,  time-varying  plant  parameters 
and  reduced  order  models  to  be  analyzed  in  a  unified  manner. 

In  section  II  the  error  model  is  posed.  If  u(t)  is  an  input  vector  of  time- 
functions,  v(t)  a  scalar  output  disturbance  and  x(t)  a  parameter  error  vector, 
the  error  equation  is  given  by: 

x(t)  =  -yu(t)uT(t)x(t)  -  yu(t)v(t)  (1) 

For  problems  arising  in  identification  It  can  be  assumed  that  both  u(t)  and  v(t) 
are  uniformly  bounded.  If  u(t)  is  sufficiently  rich  the  homogeneous  equation  Is 


\ 


-2- 

uniformly  asymptotically  stable  and  hence  a  bounded  v(t)  produces  a  bounded 
x(t).  The  latter  can  be  derived  in  terms  of  the  bounds  on  v(t)  as  well  as  the 
richness  of  u(t) . 

It  can  be  demonstrated  that  x(t)  may  become  unbounded  when  u(t)  is  not 
sufficiently  rich.  Three  examples  of  second  order  systems  are  given  which 
illustrate  the  type  of  behavior  possible  in  such  cases.  It  is  interesting  to 
note  that  sufficient  conditions  for  the  boundedness  of  x(t)  call  for  either  a 
sufficiently  rich  input  u(-)  or  a  u  e  which  does  not  even  assure  the  asymp¬ 
totic  stability  of  the  homogeneous  equation. 

More  interesting  theoretical  questions  arise  when  u(t)  and  v(t)  are  corre¬ 
lated  and  cannot  be  assumed  to  be  uniformly  bounded,  as  for  example  in  the  adap¬ 
tive  control  problem.  While  investigation  of  this  problem  is  still  in  the 
initial  stages,  an  attempt  is  made  in  section  VII  to  formulate  and  analyze 
a  specific  error  model.  Using  this  error  model,  which  contains  a  non¬ 
linearity  (dead-zone)  in  the  adaptive  law  for  updating  control  parameters, 
sufficient  conditions  are  derived  to  assure  the  boundedness  of  parameter  and 
output  errors. 

II .  Error  Models: 
a)  The  First  Error  Model 

Figure  1  represents  the  first  error  model  which  has  been  extensively  analyzed 

in  the  adaptive  literature  [9].  u(.)  is  an  n-dimensional  vector,  x(*)  is  a 

T 

parameter  error  vector  and  e(*)  is  an  output  error  which  is  given  by  e  ■  x  u. 

The  vector  x(t)  is  updated  according  to  the  adaptive  law  x  =  -Te(t)u(t)  where 


u(t) 


>  e(t) 


Figure  1 
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T  is  a  constant  positive  definite  matrix.  The  error  equation  can  be  expressed 
as: 

x(t)  =  -Tu(t)u(t)  x(t)  (2a) 

which  is  a  time-varying,  homogeneous,  differential  equation.  For  the  particular 
case  where  T  «  Yl  the  error  equation  has  the  form 

rfr)  *=  -Yu(t)u(t)Tx(t)  (2b) 

and  the  constant  Y  is  the  adaptive  gain.  For  ease  of  exposition,  the  equation 

(2b)  is  used  throughout  this  report.  Using  a  Lyapunov  function  candidate 

xT  t  2 

V(x)  »  it  follows  directly  from  V(x)  *  -Y(u  x)  that  the  equilibrium  state 

of  (2)  is  uniformly  stable.  For  u(*)  "sufficiently  rich"  defined  by 
t+T 

[  |uT(T)w|dt  ?  k  T  +  k'  (3) 

J  1  1 

t 

» 

(for  arbitrary  t  and  T  >  0  and  for  all  unit  vectors  w  there  exist  k^  >  0  and  k^ 
such  that  (3)  is  satisfied),  it  has  been  shown  [ 10]  that  (2)  is  uniformly  asymp¬ 
totically  stable  (u.a.s.).  Bounds  on  the  rate  of  convergence  of  in  such 

a  case  have  been  derived  in  [11]  and  [12]. 
b)  Error  Model  with  Output  Noise 

When  the  output  of  the  plant  is  corrupted  with  noise,  or  when  the  plant 
parameters  vary  with  time,  the  error  model  can  be  described  by  a  non-homogen eous 
differential  equation. 

In  Figure  2  v(t)  represents  a  disturbance  at  the  output.  If  the  same  adap¬ 
tive  law  as  in  the  previous  case  is  used  to  update  x(t)  the  error  model  is 

v(t) 


Figure  2 
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described  by 

x(t)  =  -ye(t)u(t)  =  -yu(t)uT(t)x(t)  -  yu(t)v(t)  (4) 

Various  assumptions  can  be  made  regarding  v(t)  in  equation  (4).  For  example  if 
v(t)  is  stochastic,  uncorrelated  with  u(t)  and  u(t)  is  sufficiently  rich  and  Y(t) 
is  a  time-varying  gain  which  tends  to  zero  in  a  specific  manner  it  has  been  shown 
[13]  that  II  HI  tends  to  zero  in  a  mean  square  sense. 

However  our  interest  lies  in  less  restrictive  cases  where  only  a  bound  on 
v(t)  can  be  assumed  and  further  v(t)  and  u(t)  may  be  correlated.  Also,  virtually 
all  applications  of  adaptive  systems  theory  involve  time-varying  plant  parameters  and 
the  adaptive  gain  y(t)  cannot  tend  to  zero.  If  u(t)  is  sufficiently  rich  and  the 
homogeneous  equation  (2)  is  u.a.s.,  the  bounded  forcing  term  ~u(t)v(t)  in  (4) 
will  produce  a  bounded  parameter  error  vector  x(t).  If  u(t)  is  not  sufficiently 
rich,  INI  may  be  unbounded  and  in  such  cases  our  interest  lies  in  classifying  the 
behavior  of  equation  (4)  for  different  types  of  inputs. 

In  section  III  bounds  are  derived  on  ||x(t)||  for  the  noisy  case  using  the  ex¬ 
plicit  form  of  the  error  equation  (4).  In  section  IV  similar  bounds  on  II ’‘“>11  are 
derived  using  the  results  of  [11]  and  [12]  when  the  forcing  term  w(t)  is  independent 
of  the  input  u(t).  Such  a  situation  arises  when  no  output  disturbance  is  present 
but  the  plant  parameters  vary  with  time.  Section  V  deals  with  situations  in  which 
bounded  inputs  u(t)  and  v(t)  result  in  an  unbounded  output  x(t).  Specific  examples 
of  such  behavior  are  also  given.  Section  VI  briefly  describes  identification  prob¬ 
lems  which  can  be  analyzed  using  the  results  in  sections  III-V.  The  last  section 
makes  a  first  attempt  at  formulating  an  error  model  derived  from  equation  (4)  which 
applies  to  the  control  problem. 

III.  Bounds  on  |x||  when  u  is  sufficiently  rich: 

In  the  non-homogeneous  equation  (4) 

•  T 

x(t)  =  -Yu ( t ) u  (t)x(t)  -  Yu(t)v(t) 


\ 
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the  following  assumptions  are  made: 

For  all  t  c  [0,“) 

(i)  | v ( c)  |  i  vQ 

(ii)  constants  >  0  and  0  <  T  <  «>  exist  such  that 
t+T 


|u  (i)w|dT  >  k  for  all  constant  unit  vectors  w.  (5) 

J  1 

t  t+T 

(iii)  A  constant  k^  exists  such  that  f  |Ju(t)||  di  <  k^  <  00  . 

Although  assumption  (ii)  is  not  identical  in  form  to  the  "richness",  "mixing",  or 
"persistently  exciting"  conditions  that  have  appeared  in  the  literature  [10-12] 
it  is  equivalent  to  them  [10].  In  lieu  of  the  constraint  on  ||u(*)||  generally 
used  the  less  restrictive  integral  constraint  (iii)  is  used  in  the  following  dis¬ 
cussion;  if  [|u(t)||  £  1,  k„  =  T.  The  richness  of  u(t)  is  a  function  of  k^,k^,  and 
T.  If  any  two  of  these  are  held  constant  and  the  third  varied,  richer  u(t) 
is  implied  by  larger  k^ ,  smaller  and  smaller  T. 

If  k^  and  k2  are  defined  by; 

\  =  k^T  and  k^  =  k^T 


they  represent  average  values  of  |u  w|  and  ||u||  over  the  interval  [t,t+T). 
S  ince 

jjr[xT  (t)x(  t)  ]  =  -2y[  (uT(t)x(t))  2  +  uT(t)x(t)v(t)  ]  , 
it  follows  that  AW(t)  =  [x  (t+T)x(t+T)  -  x^(t)x(t)] 


t+T 


t+T 


-2y [ (uT(t)x(t) ) 2  +  uT(t)x(t)v(t) ] d t  . 


V  t  c  [  0 ,  °° ) 


r)x(r))  dr  i  ~ 


f  T 

Since  j  (u  (t 
1 
t 

t+T 

AW(t)  <  ^  [  |uT(x)x(T)|dT 


t+T 

r  t1 

j |u 


(t)x(t) J  dr 


and  by  assumption  5(i) 


t+T 


[ u  (t)x(t) I d t  -  vqT 


L  t 


(6) 


\ 
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Hence  Aw(t)  f  0  or  ||x(t)||  is  non-increasing  in  the  interval  [t,t+T]  if 
t+T 

(  |uT(t)x(t) Idx  i  v  T  (7) 

J  u 

t 

T  T 

From  equation  (6)  it  also  follows  that  if  |u  x|  >  v^  or  if  sgn(u  x)  =  sgn(v), 

T 

(x  x)  <  0  or  ||  xjj  decreases .  Hence  for  |Jx||  to  increase  it  is  necessary  that 


dt 


|u  x  +  v|  <  v  .  In  such  a  case  we  have, using  equation  (4)  and  assumption  5(iii), 


X(T)  -  X(t)|| 


T 

[  T 

|  yu(s) [u  (s)x(s)  +  v(s))ds 

J 

t 


<  Yk^  for  t  c  [ t , t+T) 


(8) 


Equation  (8)  sets  a  bound  on  the  change  in  x(t)  in  an  interval  of  length  T  when 
||x(t)||  is  increasing. 

From  equations  (4)  and  (8)  and  assumptions  5 ( i  i)  and  5(iii)  it  follows  that 
t+T  t+T  t+T 

(  |uT(t)x(t) | dx  >  (  |uT(x)x(t) i dr  -  |  |uT(t)[x(t)  —  x(t) J  j  dx 


Equivalently,  if 


5  kx  ||x(t)||  -  YvQk2' 


(9) 


x(t)||  > 


v  [T  +  Yk2 


(10) 


then  J  x  ( t+T)|  <  Jx  ( t)||  • 

Further  since  [x^x]  <  finite  escape  times  are  not  possible  and  hence  ||x(t)|| 

is  bounded.  The  bound  on  |tx(t)||  can  be  expressed  equivalently  as 


Bx(t)||  < 


Vptl  +  YTk22] 

TT 

1 


(ID 


where  k^  and  k2  are  the  average  values  defined  above. 

Equations  (10)  and  (11)  reveal  clearly  the  relation  between  the  bound  on  H*(t)ll 
and  the  richness  of  the  input  u(t)  as  well  as  v^  and  the  adaptive  gain  y .  Tighter 
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bounds  are  obtained  when  richer  inputs  are  used  i.e.  T  and  k2  are  small  and  k 
is  large.  From  (11)  it  is  seen  that  as  k^  -*■  0  the  bound  on  ||x(t)|)  becomes 
arbitrarily  large. 

In  the  non-homogeneous  equation  (4)  the  forcing  term  -yu(t)v(t)  depends  on 
u(t) .  In  the  following  section  we  consider  the  case  where  the  forcing  term,  repre¬ 
sented  by  w(t),  is  an  independent  bounded  time  function. 

•  T 

IV .  The  Error  Equation  x(t)  =  -u(t)u  (t)x(t)  +  w(t): 

Error  equations  of  this  form  arise  when  the  parameters  of  the  plant  being 
identified  vary  with  time.  If  u(t)  is  sufficiently  rich  a  bounded  w(t)  results 
i  nJI  x  ( t  )||  being  bounded.  Bounds  on  ||x(t)§  with  different  integral  constraints  on 
w(t)  have  been  analyzed  in  [11]  by  Sondhi  and  Mitra  and  are  included  here  for  the 
sake  of  completeness. 

Given  an  input  vector  u(t)  and  an  unknown  time-varying  parameter  vector  k(t), 

let  the  output  y  (t)  be  described  by 
P 

y  (t)  =  kT(t)u(t) . 
p 

Let  k(t)  denote  the  estimate  of  k(t)  and  let 

y  (t)  =  kT(t)u(t) 
m 

where  y  (t)  denotes  the  output  of  a  model, 
m 

If  y  (t)  -  y  (t)  =  e(t)  and  k(t)  -  k(t)  =  x(t),ve  have  the  first  error  model 

rap 

xT(t)u(t)  =  e(t) 


However,  in  this  case  the  adaptive  law  is  implemented  as 


k(t)  =  -ye( t)u(t) 


and  yields  the  parameter  error  equation: 


-8- 


the  condition 
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t+T 


,  u(t)u(r)  dT  <  k  I  V  t  r[0.“>)  and  some  T  < 

1  J  1 

t 

is  satisfied,  the  following  bound  can  also  be  derived. 


Y  k  T 
<  2  1 

-bT 

1-e 


Yk2Wl 


(16) 


From  inequalities  (15)  and  (16)  it  is  clear  that  the  asymptotic,  bounds  on  |pt(t)Jj 

depend  on  the  nature  of  tin-  plant  parameter  variations.  If  only  the  rate  of  change 

of  the  plant  parameters  is  bounded, |x|m  is  inversely  proportional  to  y  for  small 

values  of  y  and  proportional  to  y  for  large  y.  If,  on  the  other  hand,  the  plant 

parameter  variations  are  restricted  to  a  compact  region  in  parameter  space, the  bound 

2 

on  ||  x  I!  is  independent  of  Y  for  small  values  of  Y  and  proportional  to  y  for  large  Y. 
Ii  1 1® 

If  both  output  disturbance  v(t)  and  plant  parameter  variations  (k(t)  t  0)  are 
present  the  analysis  in  sections  III  and  IV  can  be  used  to  determine  the  bounds  on 
llx ( t )l |  .  The  non-homogeneous  equation  has  the  form 


x(t) 


-Yu(t)u 


T 


(t)x(t) 


yu( t)v(t) 


k(t) 


Due  to  linearity  the  total  effect  on  x(t)  is  the  sum  of  the  effects  of  the  two  inputs. 

In  practice  the  choice  of  the  adaptive  gain  y  must  therefore  be  a  compromise 
between  tracking  time  varying  parameters  with  a  small  error  and  filtering  the  effects 
of  output  disturbances. 

V.  Behavior  of  Error  Model  When  u(t)  is  Not  Sufficiently  Rich: 

In  sections  III  and  IV  it  was  assumed  that  u(t)  is  sufficiently  rich  so  that 
the  homogeneous  equation  is  uniformly  asymptotically  stable.  This,  in  turn,  assures 
the  boundedness  of  the  parameter  error  vector  x(t)  when  v(t)  and  w(t)  are  uniformly 
bounded.  When  u(t)  is  not  sufficiently  rich  but  v(t),w(t)  0  it  was  also  shown  that 

the  system  is  uniformly  stable.  The  question  naturally  arises  whether  the  error 
models  considered  so  far  can  result  in  unbounded  x(t)  for  bounded  functions  v(t) 
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and  w(t).  In  this  section  some  specific  examples  are  given  where  such  is  indeed 
the  case. 

a)  Scalar  Equation 

We  first  consider  the  scalar  equation 


x  ( t )  =  -u  (t)x(t)  -  u(t)v(t) 


07) 


where  u  and  v  are  bounded  scalar  function.-.  If  u  1  L  the  homogeneous  system  is 

.  ,  2 

stable  but  not  asymptotically  stable;  u  f  l  assures  asymptotic  stability  and 
2 

j  u  (r)dT  >  at  +  b  for  t  r  [0,'D)  and  for  some  constants  a  >  0  and  b,  assures  uniform 
Asymptotic  stability.  In  the  last  case  the  input  is  sufficiently  rich  and  the 
system  is  also  exponentially  stable. 

The  non-homogeneous  case  can  be  classified  as  follows. 

Case  (1)  If  u  f.  L  (  the  output  x(t)  is  bounded.  Examples  include  u  -  0  and 
u(t)  =  l/ta  (a  >  1). 

Case  (ii)  If  u  t  L ^  but  u  i  L * 


X(t)  =  -  |  ll(t,T)u(T)v(T)dT 
J 

C0 

where  I  t ,  t )  |  >  H  >  0  for  some  constant  M. 
Choosing  v(t)  =  sgn  u(t),  we  have 

V 


:(t)  |  >,  M  j  |u(T)  |  da 


1 


“0 


Since  u  t  L  ,  1  im  ||x(t)l|  =  00 . 

Ct 

Examples  include  u(t)  =  1/t  for  1/2  c  n  <  1 . 

2 

Case  (iii)  I f  u  i  L  but  is  not  sufficiently  rich  two  possible  situations  can  arise. 

1)  No  v(t)  exists  such  that  the  system  has  unbounded  outputs.  An  example 
of  this  is  a  binary  valued  function  u(t)  which  assumes  the  values  0 

or  1  for  all  t  e  (0,'»)  and  satisfies  the  above  conditions. 

2)  As  in  case  (ii)  a  v(t)  can  be  determined  which  results  in  x(t)  being 


unbounded . 
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1  /  2 

An  example  is  u(t)  =  1/t 

Case  (i)  provides  sufficient  conditions  for  bounded  outputs.  Case  (ii)  pro¬ 
vides  sufficient  conditions  for  realizing  unbounded  outputs;  the  homogeneous  system 
is  not  asymptotically  stable  and  u  t  L  .  At  the  present  time  necessary  and  sufficient 

conditions  for  unbounded  outputs  are  not  available. 

•  T 

b)  Vector  Equation  x  =  -u(t)u  (t)x(t)  -  u(t)v(t)  (18) 

Conditions  similar  to  those  stated  for  the  scalar  case  can  also  be  derived 


for  the  vector  case. 


(i)  Let  u ( t ) 


u  j  ( t )' 
u2(t) 


where  u^  and  u^  are  n^  and  n2  dimensional  vectors  respec- 


L  J  1  1 

tively.  Let  u^  be  sufficiently  rich  in  !R  and  c  L  ,  Then  the  output  x(t)  is 
uniformly  bounded.  Only  a  brief  outline  of  the  proof  is  given  below. 


X1  =  -u1(t)u1T(t)x1(t)  "  UjCtlvCt)  -  u1(t)u2(t)x2(t)  (19a) 

x2  =  -u2(t)u2T(t)x2(t)  -  u2(t)v(t)  -  u2(t)u1(t)Tx1(t)  (19b) 


From  equation  (19)  it  follows  that  x^  and  x2  are  either  both  bounded  or  both  unbounded. 
In  the  latter  case,  from  (19a)  x^(t)  grows  slower  than  x2(t)  since  u2  £  L  •  From 
(19b)  it  can  be  shown  that  x^  and  x ^  grow  at  the  same  rate  and  hence  this  results 
in  a  contradiction. 

An  example  of  this  is  when  u  is  a  constant  vector.  This  can  be  cast  in  the 
T 

form  u  =  [u^,0  ...0]  where  u^  is  a  scalar  and  u2  E  0  an  n  -  1  dimensional  vector. 

(ii)  To  determine  situations  in  which  the  output  x(t)  grows  in  an  unbounded 

fashion  we  consider  conditions  similar  to  case  (ii)  in  (a). 

1  2 

If  u  i  L  and  u  e  L  ,  the  bounded  function  v  can  be  chosen  so  that  x(t)  is 

unbounded.  If  4>,  (t,t)  ,. .  .  (t,x)  are  the  rows  of  the  transition  matrix  $(t,i) 

1  n 


of  (18) 
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x  ( t )  =  - 


<*>2  ( t ,t)u(t) 


<t>  (  t  ,t)u(t) 

L  n 


v(T)dT 


The  homogeneous  system  is  uniformly  stable  but  not  asymptotically  stable  and 
lh<t.T)||  1  M  '  0  for  all  t,  t  t  Further  since  u  i  L ^ ,  there  exists  at  least 


one  function  $  (t,T)u(T)  such  that 


l. 

[  |*,(t,T)u(T> |dT  is  ur 


. .  .  ,  inbound ed 

J  t  1 

as  t  -  <=.  Hence  choosing  v(t)  =  sgn  4>  ( t  ,t  )  u(t)  the  output  may  be  made  unbounded. 

2 

(iii)  As  in  the  scalar  case,  if  u  is  not  sufficiently  rich  but  u  i  L  the  resulting 
system  can  exhibit  both  bounded  and  unbounded  behavior.  Two  examples  of  unbounded 


behavior  are  given  below 

cos  fit 

I 

If  u(t)  = 


and  v(t)  =  -2  then  x(t)  = 


cos/IF  +  fit  sin  fit 
sin/2t  -  /2t"  cos  /2t 


sin/Tt 

is  an  unbounded  solution  with  |[x||  growing  as  ft  .  A  computer  simulation  of  such  a 
system  is  shown  in  Figure  3.  Figure  4  shows  the  computer  simulation  for  the  case 
when 

i 

u(t)  =  v(t)  =  -2  sgn[sin/F 

,/T 


and  once  again  ||x|  grows  as  ft  .  In  both  cases  u(t)  is  such  that  the  homogeneous 

equation  is  asymptotically  stable. 

•  T 

c)  Vector  Equation  x  =-u(t)u  (t)x(t)  +  w(t) 

In  this  case  the  forcing  term  w(t)  is  independent  of  u(t)  and  is  assumed  to  be 
uniformly  bounded.  It  follows  directly  that  if  u(t)  is  sufficiently  rich  x(t)  will 
also  be  uniformly  bounded.  If  u(t)  is  not  sufficiently  rich  it  is  well-known  that 
bounded  inputs  w(t)  can  be  found  which  result  in  unbounded  x(t). 


Figure  5 


While  many  simple  examples  of  such  behavior  can  be  given,  we  present  below 
one  which  is  particularly  relevant  for  the  case  of  time  varying  parameters  described 
earlier.  In  Figure  5,  if  u(t)  is  defined  by 


and  t ^  ■  t^  ^  +  2(i-l)ir^ 

For  i  -  2...«°,  arbitrary  t^  and  w(t)  is  a  sequence  of  impulses  which  are  alternately 
positive  and  negative  and  occur  when  x(t)  has  rotated  through  an  angle  it  is  seen 
that  the  norm  of  x(t)  can  be  made  arbitrarily  large. 
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VI.  Application  to  Identifiers  and  Adaptive  Observers: 

The  error  models  described  so  far  find  direct  application  in  identifiers  and 
adaptive  observers.  Two  simple  typical  cases  are  described  in  this  section, 
a )  I dentif ier 

Let  w  (s)  be  the  stable  unknown  transfer  function  of  a  plant  which  has  to  be 
P  N 

identified.  If  w  (s)  is  parametrized  as  w  (s)  =  T  w.(s)k.  where  w.(s)  are  known 

P  P  i=1  1  1  i 

stable  transfer  functions,  the  identification  problem  is  to  estimate  the  constants 

k^.  This  is  carried  out  by  constructing  a  model  whose  transfer  function  is 
N 

Z  w  (s)k.  and  adjusting  k.(t)  so  that  the  error  between  model  and  plant  outputs  tends 
i=l  1  1  1 

to  zero.  Defining  the  bounded  reference  input  to  both  plant  and  model  as  r(t),  plant 

output  as  y  (t)  and  model  output  as  v  (t),  and  w.(s)r(t)  =  u . ( t) ,k . ( t) -k .  =  $ . 

p  p  l  t  ill 

y  (t)  -  y  (t)  =  e(t),the  error  equation  may  be  expressed  as 
P  P 

N  AT 

Z  <(>  (t)u  (t)  =  <t>  (t)u(t)  =  e(t) 

i=l  1  1 

which  is  the  first  error  model. 

Case  (i):  If  the  output  of  the  plant  is  corrupted  with  observation  noise  v(t)  we 
have 

<&T(t)u(t)  +  v(t)  =  e(t) 


which  is  the  error  model  considered  in  section  II. 
Case  ( 11) :  Let  a  reduced  order  model  of  the  form 


1 

Z  w  (s)k  N  <  N 

i=l  1  1 

N 

be  used  to  represent  the  plant.  If  Z  k.w  (s)r(t)  =  v  (t),  then  v  (t)  represents 

i-N  +1  11 

the  residual  error.  The  output  of  the  plant  can  be  expressed  as 


yp(t)  =  yp(t)  + 


's'  is  used  as  both  the  Laplace  transform  variable  and  the  operator  ^  . 
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Ni  - 

and  1  k  w  (s)r(t)  =  y  (t)  is  the  estimate  of  y  (t).  In  this  case  the  error  equation 
i=l  1  1  '  P  P 

is  given  by 

4>T(t)u(t)  —  v  ^  ( t )  =  e(t)  (20) 

(where  $  and  u  are  now  dimensional  vectors).  From  equation  (20)  it  is  seen  that 
the  residual  error  v^(t)  enters  the  error  model  as  a  disturbance. 

Case  (iii):  If  in  case  (i)  v(t)  =  0  but  the  plant  parameters  k^(t)  vary  with  time 
the  error  equation  has  the  form 

T 

4>  ( t)u(t)  =  e(t) 

but  the  law  for  adjusting  k(t)  reduces  to 

4> ( t )  =  -Yu(t)uT(t)<Kt)  -  k(t) . 

If  a  plant  with  time-varying  coefficients  is  identified  in  the  presence  of 
output  noise  bv  a  reduced  order  model  all  the  effects  discussed  in  cases  (i)-(iii) 
must  be  included.  In  such  a  case  the  overall  error  equation  has  the  form 

$(t)  =  -lu(t)uT(t)<i>(t)  -  Y [ v( t)  +  v^(t)  ]u(t)  -  k( t) 

and  can  be  analyzed  using  the  results  of  the  earlier  sections. 

The  error  models  described  in  sections  3  and  5  apply  directly  to  cases  (i) 
and  (iii).  Hence,  by  the  proper  choice  of  the  input  u(’)  and  the  disturbance  v(*), 
or  k(*),  it  is  possible  to  make  the  parameters  of  the  model  unbounded  as  described 
In  section  V.  In  case  (ii)  the  input  vector  u(t)  and  the  residual  error  v^(t)  are 

oo  J 

correlated.  If  r(")  c  L  nL  or  r(’)  is  sufficiently  rich  it  follows  from  the 
results  of  section  V  that  the  parameters  of  the  model  will  be  bounded.  It  can 
also  be  shown  that  u(*)  and  v(»)  do  not  satisfy  the  sufficient  conditions  given  in 
section  5  for  unbounded  parameter  errors.  However,  so  far,  it  has  not  been  demon- 


V 
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9trated  conclusively  that  the  parameters  of  the  model  will  remain  bounded, 
b)  Adaptive  Observers 

The  adaptive  observer  of  Luders  and  Narendra  with  observation  noise  Is  shown 
in  Figure  6.  The  unknown  plant  has  a  stable  rational  transfer  function  N(s)/D(s). 

The  output  of  the  plant  is  y^(t),  but  can  be  observed  only  in  the  presence  of 
additive  noise  v(t).  The  input  and  noisy  output  are  processed  through  state  vari¬ 
able  filters  (denoted  by  the  operator  F)  to  generate  the  vectors  u^(t)  and  u^(t). 

TAT  T  TAT  T 

If  6  (t)  -  [0^  (t),©2  (t)]  and  u  (t)  =  [u^  (O.u^  (t)],  then  the  output  of  the  observer 

is  y  (t)  where 
P 

y  (t)  *  eT(t)u(t) 
p 

it 

If  the  vector  0  represents  the  plant  parameter  vector  using  this  parametrization , 

AT  * 

the  parameter  error  vector  x(t)  may  be  defined  as  x(t)  =  6  (t)  -  6  .  It  is  easily 


v(t) 


Figure  6 


V 
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shown  that  the  output  error  between  observer  and  plant  outputs  (i.e.  e(t)  =  y  (t) 

P 

-  Vp(t)  -  v(t))  satisfies  the  equation 

xT(t)u(t)  -  V!  (t)  =  e(t) 

where  v^(t)  =  v(t)  -  0^  Fv(t) 

-  iTY 

R(s) 

where  R(s)  is  the  characteristic  polynomial  of  the  filter.  Therefore,  the  analysis 
of  the  adaptive  observer  of  Figure  6  reduces  to  the  analysis  of  the  error  model  of 
section  lib. 

VII.  Adaptive  Control  in  the  Presence  of  Disturbance: 

In  sections  II  to  VI  it  was  assumed  that  the  input  vector  u  and  the  disturbance 
v  are  uniformly  bounded.  While  this  assumption  on  u  is  a  reasonable  one  for  identi¬ 
fication,  it  is  no  longer  valid  in  the  control  case.  The  principal  problem  here  is 
to  establish  the  boundedness  of  all  signals  and  parameters  as  was  done  in  [1-6] 
for  the  disturbance  free  case.  In  this  section,  we  propose  a  nonlinear  adaptive 
law  which  appears  to  have  potential  for  the  resolution  of  the  general  adaptive 
control  problem  with  a  bounded  disturbance.  The  case  of  a  simple  system  described 
by  a  scalar  differential  equation  is  considered  first  to  illustrate  the  principal 
concepts . 

a)  The  Scalar  Control  Problem 

An  unstable  plant  is  described  by  the  linear  t ime- invariant  differential  equation 


y  =  -a  y  +  w(t) 
P  P  P 


a  <  0 
P 


It  is  desired  to  stabilize  it  using  feedback  such  that 


w(t)  =  -9(t)yp(t) 
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Figure  7 

as  shown  in  Figure  7.  The  plant  parameter  a  is  unknown  and  the  control  parameter 

P 

6(t)  has  to  be  adjusted  using  all  available  signals  in  the  system. 

(i)  If  no  disturbance  is  present  and  the  adaptive  law 

0(t)  *>  +  yy  2(t)  y  >  0  (21) 

P 

* 

suggested  in  [lb]  is  used,  it  follows  that  lim  y  (t)  =  0  and  lim  0(t)  ■  0  ,  where 
*  *  P  t— 

0  Is  a  constant  such  that  -  a  -  0  <0.  In  other  words,  the  parameter  0(t)  is 

★ 

a  non-decreasing  function  of  time  and  converges  to  some  constant  0  (depending  on 
Initial  conditions)  such  that  the  feedback  loop  is  asymptotically  stable. 

(ii)  For  Model  Reference  Adaptive  Control  (MRAC) ,  a  stable  model  described  by 

*  +  r<0,  ■  >  0 
m  id  m  id 

(where  the  reference  input  r(t)  is  uniformly  bounded)  is  specified  and  it  is  desired 
to  track  y  (t)  with  the  output  of  the  plant. 

IB 

if 

e(t)  -  y  (t)  -  y  (t) 

p  ID 
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and  the  control  input  to  the  plant  is 


w(t)  =  r ( t )  -  0 ( t ) y  (t) 
P 

where  0 ( t )  is  adjusted  using  the  adaptive  law 


0(t)  =  +ye(t)y  (t) 
P 


(22) 


then 

1 im  e(t)  =  0  and  1 im  a  +  6(t)  =  a 

£-WX>  ^  m 

if  the  input  is  sufficiently  rich. 

(iii)  If  in  case  ( i)  the  observed  output  of  the  plant  y(t)  is  corrupted  with 
additive  noise  v(t),  then 


y(t)  =  y  (t)  +  v(t) 

P 

If  the  same  adaptive  law  (  21  )  is  used  with  y  (t)  replaced  by  v(t) ,  the  overall 

P 

system  is  described  by  the  equations 


where 


y(t)  =  -(a  +  0(t))v(t)  +  v  (t) 

P  1 

0 ( t)  =  yy2(t) 

v,  (t)  =  v(t)  +  a  v(t) 

1  P 


(23) 


From  equation  (  23)  it  is  seen  that  8(t)  is  a  non-decreasing  function  of  time 

2 

and  will  be  unbounded  if  y  does  not  belong  to  L  .  It  can  be  shown  that  a  necessary 

2 

and  sufficient  condition  for  lim  o(t)  =  <»  is  v  £  L  . 

£-*ao  1 

The  above  result  implies  that  the  parameter  9(t)  will  grow  in  an  unbounded 
fashion  in  most  practical  situations  where  the  disturbance  does  not  tend  to  zero 
with  time.  It  is  perhaps  also  worth  noting  that  the  observation  noise  v(t)  can  be 
replaced  by  an  input  noise  v^(t)  without  affecting  the  analysis  carried  out  so  far. 


for  any  constant  £  >  0,  all  signals  y(t),0(t)  and  w(t)  remain  bounded.  The  smaller 
the  value  of  e  chosen,  the  larger  is  the  limiting  value  of  the  parameter  0(t). 
Figure  8  shows  the  nature  of  the  trajectories  in  the  (y,9)  space. 

(v)  The  results  of  case  (iv)  can  also  be  extended  to  the  MRAC  problem  treated  in 
(ii) ,  when  observation  noise  is  present.  The  objective  in  this  case  is  to  track 
the  output  of  the  reference  model  with  output  y(t)  of  the  plant,  with  a  bounded 
error. 

The  feedback  gain  8(t)  in  this  case  cannot  be  adjusted  to  make  the  observed 
output  error  arbitrarily  small,  since  the  latter  is  determined  both  by  the  noise 
Vj(t)  as  well  as  the  mismatch  between  plant  and  model.  Hence,  the  dead-zone  cannot 
be  made  arbitrarily  small.  The  equations  describing  the  observed 
error  e(t)  and  the  parameter  error  $(t)  are: 
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where  v(t)  and  v^(t)  are  as  defined  in  (iii).  Using  the  nonlinear  adaptive  law 


4>(t)  =  0(t)  =  ye(t)y(t) 


:(t) 


(26) 


I  e  ( t )  !  < 


it  is  seen  that  the  function  V(e,<J>)  =  — (e  +  ~  <b  )  decreases  when  e(t)i  >  —  and 

l  Y  a 

v0  m 

adaptation  is  effective.  When  |e(t)|  <  —  no  adaptation  takes  place,  6  is  a  constant 

a 

m 


and  V  ( e ,  4>)  is  bounded. 

The  analysis  of  cases  (i)-(v)  indicates  that  the  use  of  a  nonlinear  adaptive 
law  may  be  effective  in  achieving  a  hounded  error  in  more  general  cases,  when  obser¬ 
vation  noise  is  present.  This  is  treated  in  the  next  section, 
b )  Adaptive  Control  In  t h e_  Presen ce  of  Disturbance 

The  results  of  section  (a)  (iv)  carry  over  directly  to  the  adaptive  control  of 
a  single  input-single  output  time-invariant  plant  of  order  n  and  relative  degree 

■k 

n  =  1.  The  plant  is  assumed  to  satisfy  the  following  conditions: 

(1)  the  transfer  function  of  the  plant  is  w  (s)  where 

P 


w  (s) 
P 


A  N(s) 
D(s) 


N(s)  is  assumed  to  be  a  manic  polynomial  of  degree  (n-1)  with  all  its  roots  in  the 

left  half  plane.  The  characteristic  polynomial  D(s)  is  of  degree  n. 

(ii)  the  transfer  function  of  the  model  is  ww(s)  where 

M 


w  (S)  £  -J- 
mv  '  s+a 


a  >  0 


The  assumption  that  N(s)  is  monic  is  for  ease  of  exposition  and  the  results  that 

follow  do  not  depend  on  this  property. 

As  in  the  noise  free  case  [1-6],  the  uniformly  bounded  reference  input  r(t) 

and  the  model  are  specified,  y  (t)  and  y  (t)  are  respectively  the  plant  and  model 

pm 


Figure  9.  Basic  Structure  of  the  Adaptive  System. 


outputs  and  the  observed  output,  y(t)  *  y  (t)  +  v(t),  contains  additive  noise. 

P 

It  is  desired  to  determine  the  input  to  the  plant  u(t)  such  that 

e  (t)  =  y(t)  -  y  (t) 

1  m 

is  uniformly  bounded. 

The  structure  of  the  controller  used  in  this  case  is  identical  to  that  sug¬ 
gested  in  [ i 6 ]  for  the  noise  free  case.  The  input  u(t)  and  the  observed  output  y(t) 
of  the  plant  generate  the  auxiliary  vector  valued  output  oo(t)  (w(t)  = 

w,(t),...u>_  (t))  and  a  linear  combination  of  these  is  the  desired  feedback  signal 
J  zn 

T 

(i.e.  9  (t)u>(t)) .  The  entire  structure  of  plant  and  controller  is  shown  in  Figure  9. 

The  signals  w  (t)  (i  «  2,3,...,2n)  are  correlated  with  the  observation  noise 

*  * 

v(t).  From  [16]  it  is  known  that  constants  0^  exist  such  that  when  0^(t)  =  0^  and 

v(t)  5  0  the  plant  output  y^(t)  asymptotically  approaches  the  model  output  y^(t) . 

Our  objective  in  the  noisy  case  is  to  modify  the  adaptive  law  so  that  the  error 

e^(t)  remains  bounded  even  when  v(t)  is  present. 

*  A 

If  6(t)  -  e  =  $(t),  the  output  error  e^(t)  is  related  to  4>(t) ,to(t) ,v(t)  and 
the  plant  transfer  function  as  shown  in  Figure  10. 


v(t) 


Figure  10 


\ 
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The  differential  equation  describing  e^ft)  is 


e^  ( t)  =  -ae^(t)  +  4>  (t)u(t)  +  v^ft) 


(27) 


[Note  that  — is  not  proper  and  that  D(s)  is  unknown.  However  it  is  assumed  that 
L(s) 

v^(t)  is  bounded  and  that  prior  information  is  available  to  calculate  its  bound.) 
Equation  (  27)  is  similar  to  (  25)  in  section  Vll(a)  and  can  be  analyzed  along  the 
same  lines.  If  |v^(t)|  <  v^  -  £  for  some  constant  £  >  0,  the  adaptive  laws  used 
in  the  noise  free  case  are  modified  as  follows: 


9 ±  ( t )  =  -ye  (t)“  (t) 


=  0 


lel(t)l  *  cT" 


eft)  < 

1  fit 


If  V (e^ , 4>)  =  ^[e^ft)  +  y  ]  we  obtain 

•  2 

V(e1,4>)  =  (t)  +  e1(t)v1(t) 

i  v0 

Let  the  region  |e^(t)|  <  —  in  the  (e^,<|>)  space  be  denoted  by  ft.  If  ( » <t>)  e  ft 

<()(t)  is  a  constant.  Outside  this  region  v ( e , 4>)  <  0.  If  t  and  t^  denote  two  instants 

of  time  at  which  (e^t^)  .♦(t^) )  e  6ft  (i=l,2),  then  ||<j>(t2)||  £  |j  d> ( 1 1>||  for  t2  >  t^. 

IU(t)||  decreases  monotonically  when  (e  (t)  ,d>(t))  l  ft  and  adaptation  is  effec¬ 
tive.  Both  output  and  parameter  errors  are  bounded  and  in  the  limit  <t>(t)  tends  to 

*  v0 
a  constant  d>  such  that  |e,(t)|  $  —  . 

'  1  1  a 

We  have  introduced  in  this  section  a  nonlinear  adaptive  law  for  controlling  the 

parameters  of  a  general  n  ^  order  plant  with  single  input  and  single  output  and 

observation  noise.  A  preliminary  study  of  such  a  system  when  the  plant  transfer 

★ 

function  has  a  relative  degree  n^  =  1  has  been  presented  here.  A  more  detailed 

study  of  this  system,  as  well  as  the  extension  of  the  adaptive  law  to  the  general 

★ 

case  where  n^  ?  2  will  be  discussed  in  a  following  report. 


-27- 


Acknowledgment 

This  research  was  supported  by  the  Office  of  Naval  Research  under  contract 
N00014-76-C-001 7. 


Ref  er ences 

[1]  K.  S.  Narendra,  Y.  H.  Lin  and  L.  S.  Valavani,  "Stable  Adaptive  Controller 
Design  -  Part  II,  Proof  of  Stability,"  IEEE  Trans.  Auto.  Cont.,  Vol.  AC-25, 

No.  3,  pp.  440-448,  June  1980. 

[2]  A.  S.  Morse,  "Global  Stability  of  Parameter  Adaptive  Control  Systems,"  IEEE 
Trans.  Auto.  Cont.,  Vol.  AC-25,  No.  3,  pp.  433-439,  June  1980. 

[3]  K.  S.  Narendra  and  Y.  H.  Lin,  "Stable  Discrete  Adaptive  Control,"  IEEE  Trans. 

Auto .  Cont . ,  Vol.  AC-25,  No.  3,  pp.  456-461,  June  1980. 

[4]  G.  C.  Goodwin,  P.  J.  Ramadge,  and  P.  E.  Caines,  "Discrete  Time  Multi-Variable 
Adaptive  Control,"  IEEE  Trans.  Auto.  Cont.,  Vol.  AC-25,  No.  3,  pp.  449-456, 

June  1980. 

[5]  B.  Egardt,  "Stability  Analysis  of  Discrete  Time  Adaptive  Control  Schemes," 

IEEE  Trans.  Auto.  Contr..  Vol.  AC-25,  No.  4,  pp.  710-716,  August  1980. 

[6]  J.-J.  J.  Fuchs,  "Discrete  Adaptive  Control:  A  Sufficient  Condition  for  Stability 
and  Applications,"  IEEE  Trans.  Auto.  Contr.,  Vol.  AC-25,  No.  5,  pp.  940-946, 
October  1980. 

[7]  K.  S.  Narendra  and  B.  B.  Peterson,  "Recent  Developments  in  Adaptive  Control," 
in  Methods  and  Applications  in  Adaptive  Control,  Springer  Verlag,  New  York, 

198CL 

[8]  K.  S.  Narendra  and  Y.  H.  Lin,  "Design  of  Stable  Model  Reference  Adaptive 
Controllers,"  Proceedings  of  the  Workshop  on  Applications  of  Adaptive  Control, 
Academic  Press,  New  York,  1980. 

[9]  K.  S.  Narendra,  "Stable  Identification  Schemes,"  System  Identification,  Advances 
and  Case  Studies,  Academic  Press,  New  York,  1976. 

[10]  A.  P.  Morgan  and  K.  S.  Narendra,  "On  the  Uniform  Asymptotic  Stability  of  Certain 
Linear  Nonautonomous  Differential  Equations,"  SIAM  J.  Contr.  and  Opt.,  Vol.  15, 

No.  1,  pp.  5-24,  Jan.  1977. 

[11]  M.  M.  Sondhi  and  D.  Mitra,  "New  Results  on  the  Performance  of  a  Well  Known 

Class  of  Adaptive  Filters,"  Proc.  IEEE,  Vol.  64,  No.  11,  pp .  1583-1597,  Nov.  1976. 

[12]  G.  Kreisselmeier ,  "Adaptive  Observers  with  Exponential  Rate  of  Convergence," 

IEEE  Trans.  Auto.  Contr.,  Vol.  AC-22,  No.  1,  pp.  2-8,  Feb.  1977. 

[13]  L.  Ljung,  "On  Positive  Real  Transfer  Functions  and  the  Convergence  of  Some 
Recursive  Schemes,"  IEEE  Trans.  Auto.  Cont.,  Vol.  AC-22,  No.  4,  pp.  539-551, 

Aug,  1977. 

[14]  J.  S-C.  Yuan  and  W.  M.  Wonham,  "Probing  Signals  for  Model  Reference  Identi¬ 
fication,"  IEEE  Trans.  Auto.  Cont.,  Vol.  AC-22,  No.  4,  pp.  530-538,  Aug.  1977. 


-28- 


[15]  G.  Liiders  and  K.  S,  Narendra,  "An  Adaptive  Observer  and  Identifier  for  a 
Linear  System,"  IEEE  Trans.  Auto.  Cont..  Vol.  AC-18,  No.  5,  pp.  496-499, 
Oct.  1973. 

[16]  K.  S.  Narendra  and  L.  S.  Valavani,  "Stable  Adaptive  Controller  Design  - 

Direct  Control,"  IEEE  Trans.  Auto.  Cont..  Vol.  AC-23,  No.  4,  pp.  507-5i8, 
Aug.  1978.  i 


END 


DATE 

FILMED 


DTIC 


